A globally convergent incremental Newton method
نویسندگان
چکیده
منابع مشابه
A globally convergent incremental Newton method
Motivated by machine learning problems over large data sets and distributed optimization over networks, we develop and analyze a new method called incremental Newton method for minimizing the sum of a large number of strongly convex functions. We show that our method is globally convergent for a variable stepsize rule. We further show that under a gradient growth condition, convergence rate is ...
متن کاملA Globally Convergent LP-Newton Method
We develop a globally convergent algorithm based on the LP-Newton method, which has been recently proposed for solving constrained equations, possibly nonsmooth and possibly with nonisolated solutions. The new algorithm makes use of linesearch for the natural merit function and preserves the strong local convergence properties of the original LP-Newton scheme. We also present computational expe...
متن کاملGlobally Convergent Inexact Newton Methods
Inexact Newton methods for finding a zero of F 1 1 are variations of Newton's method in which each step only approximately satisfies the linear Newton equation but still reduces the norm of the local linear model of F. Here, inexact Newton methods are formulated that incorporate features designed to improve convergence from arbitrary starting points. For each method, a basic global convergence ...
متن کاملGlobally Convergent Newton Algorithms for Blind Decorrelation
This paper presents novel Newton algorithms for the blind adaptive decorrelation of real and complex processes. They are globally convergent and exhibit an interesting relationship with the natural gradient algorithm for blind decorrelation and the Goodall learning rule. Indeed, we show that these two later algorithms can be obtained from their Newton decorrelation versions when an exact matrix...
متن کاملA Note on a Globally Convergent Newton Method for Solving Monotone Variational Inequalities
R esum e. Il est bien connu que la m ethode de Newton, lorsqu'appliqu ee a un probl eme d'in equation variationnelle fortement monotone, converge localement vers la solution de l'in equation, et que l'ordre de convergence est quadratique. Dans cet article nous mon-trons que la direction de Newton constitue une direction de descente pour un objectif non dii erentiable et non convexe, et ceci m^ ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematical Programming
سال: 2015
ISSN: 0025-5610,1436-4646
DOI: 10.1007/s10107-015-0897-y